O O F 12 3 Movements and Holds in Fluent Sentence Production 4 of American Sign Language : The Action - Based Approach 5

نویسندگان

  • Bernd J. Kröger
  • Peter Birkholz
  • Jim Kannampuzha
  • Irene Mittelberg
چکیده

9 Abstract The importance of bodily movements in the 10 production and perception of communicative actions has 11 been shown for the spoken language modality and 12 accounted for by a theory of communicative actions, Cogn. 13 Process. 2010;11:187–205. In this study, the theory of 14 communicative actions was adapted to the sign language 15 modality; we tested the hypothesis that in the fluent pro16 duction of short sign language sentences, strong-hand 17 manual sign actions are continuously ongoing without 18 holds, while co-manual oral expression actions (i.e. sign19 related actions of the lips, jaw, and tip of the tongue) and 20 co-manual facial expression actions (i.e. actions of the 21 eyebrows, eyelids, etc.), as well as weak-hand actions, 22 show considerable holds. An American Sign Language 23 (ASL) corpus of 100 sentences was analyzed by visually 24 inspecting each frame-to-frame difference (30 frames/s) for 25 separating movement and hold phases for each manual, 26 oral, and facial action. Excluding fingerspelling and signs 27 in sentence-final position, no manual holds were found for 28 the strong hand (0%; the weak hand is not considered), 29 while oral holds occurred in 22% of all oral expression 30 actions and facial holds occurred for all facial expression 31 actions analyzed (100%). These results support the idea 32 that in each language modality, the dominant articulatory 33 system (vocal tract or manual system) determines the 34 timing of actions. In signed languages, in which manual 35 actions are dominant, holds occur mainly in co-manual oral 36 and co-manual facial actions. Conversely, in spoken lan37 guage, vocal tract actions (i.e. actions of the lips, tongue, 38 jaw, velum, and vocal folds) are dominant; holds occur 39 primarily in co-verbal manual and co-verbal facial actions. 40 41

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Real-Time American Sign Language Recognition from Video Using Hidden Markov Models

Hidden Markov models (HMM’s) have been used prominently and successfully in speech recognition and, more recently, in handwriting recognition. Consequently, they seem ideal f o r visual recognition of complex, structured hand gestures such as are found in sign language. We describe a real-time HMM-based system for recognizing sentence level American Sign Language (ASL) which attains a word accu...

متن کامل

An Action-Based Concept for the Phonetic Annotation of Sign Language Gestures

Background: Communicative actions are specific movements or gestures which are accomplished by vocal tract articulators (lips, tongue, velum etc.) for speech, by facial articulators (eye brows, eye lids etc.) for co-verbal facial expression and by other bodily articulators (hands, arms etc.) for co-verbal gesturing. While action-based approaches already exist for spoken language processing it i...

متن کامل

Mirror Neurons and (Inter)subjectivity: Typological Evidence from East Asian Languages

Language is primarily constituted by action and interaction based on sensorimotor information. This paper demonstrates the nature of subjectivity and intersubjectivity through the neural mechanism and typological evidence of sentence-final particles from East Asian languages and extends to the discussion of the relationship between them. I propose that intersubjecivity is a kind of embedded or ...

متن کامل

The Goals of the Curriculum Orientation and Mobility in Iran and America (Especially the Visually Impaired Students)

This study has compared the goals and objectives of orientation and mobility (O&M) curriculums in Iran and America. The Bereday’s comparative method was used in this research. Initially the goals were defined and interpreted based on two criteria including the level of generality and the level of coverage and then they were compared by juxtaposition. The study found that American O&M curriculum...

متن کامل

What's right about the neural organization of sign language? A perspective on recent neuroimaging results.

Evidence from sign language Sign language provides a unique perspective on these questions. Because signed and spoken languages share linguistic representational structure, but differ radically with respect to their surface sensory and motor forms, a comparison of the neurobiology of the two systems can lead to a better understanding of the brain organization for linguistic processing with moda...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2010